Do you know how ChatGPT was trained? ChatGPT is "simply" a fined-tuned GPT-3 model with a surprisingly small amount of data! Moreover, ChatGPT is using 1.3B parameters where GPT-3 uses 175B parameters! It is first fine-tuned with supervised learning and then further fine-tuned with reinforcement learning. They hired 40 human labelers to generate the training data.

Check out this awesome Embedding visualization toolbox by TensorFlow: https://lnkd.in/dXw2FV25! I feel that one of the silent heroes in the emergence of Data Science in the past decade has been the expansion of data visualization tools. It is less glamorous than many Deep Learning discoveries, but I am not sure we would be we are without those. One heavy influence on the world of data science has been the"The Grammar of Graphics" book by Leland Wilkinson in 2005 (https://lnkd.in/dWQRGwUD) This led to the creation of Ggplot2 in 2007 (https://lnkd.in/dEmQ4juJ).